Using augmented reality for secure transactions

ABSTRACT

A method for using an Augmented Reality (AR) device for processing transactions initiated at another device. The method includes acquiring, via an AR device, an image of a display of a user device. The method includes determining, based on image analysis of the image, that the user device displays an interactive transaction element for a transaction between the user device and a server. The method includes communicating with a server, that provides the interactive transaction element, to move functionality of the interactive transaction element from the user device to the AR device. The method includes generating a new interactive transaction element providing access to the transaction at the server. The method also includes providing access to the new interactive transaction element that is visually projected via the AR device.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.15/720,067, filed Sep. 29, 2017 and issued on Oct. 1, 2019 as U.S. Pat.No. 10,430,778, which is incorporated by reference in its entirety.

BACKGROUND

Embodiments of the inventive subject matter generally relate to thefield of augmented reality and, more particularly, to using augmentedreality to initiate transactions.

Augmented Reality (AR) is a computer-generated environment that augmentsuser's view of a real-world environment using computer-generatedelements, such as sound, video, and/or other sensory outputs. AR can beimplemented using computer-generated images that overlay a user-accessedview of a real-world. AR images can be displayed via AR glasses that areworn by the user, and thus can augment the real-world view seen by theuser. For example, AR can be used to display supplemental images aboutcertain elements in a field of vision of the AR glasses. Thesupplemental images are displayed in a way that aligns with real-worldelements seen by the user.

A computer system that implements AR can access images of the real-worldin the field of vision of the AR glasses. The computer system can thenperform image analysis to detect certain elements in the accessed image.Based on element detection, the computer system can determine AR imagesto superimpose over the accessed image. The AR images can be movedand/or resized as the user moves the AR glasses and/or when the detectedelements move, which can be caused by the user walking, user's headmovement, movement of the detected elements, and/or via other movements.The user may also access a transaction system, such as a payment system,to conduct one or more transactions using an account of the user.However, the user may not obtain any benefit of using AR devices whenaccessing such a transaction system.

BRIEF DESCRIPTION OF THE DRAWINGS

The present embodiments may be better understood, and numerous objects,features, and advantages made apparent to those skilled in the art byreferencing the accompanying drawings.

FIG. 1 is a system diagram illustrating embodiments of a system thatuses an AR device for securely processing transactions that areinitiated at another device.

FIG. 2 is a flow diagram illustrating embodiments of operations forusing AR for secure transactions.

FIG. 3 is a diagram illustrating embodiments of using an AR device toaccess transactions initiated at another device.

FIGS. 4A and 4B are diagrams illustrating embodiments of a display shownby an AR device when implementing AR for secure transactions.

FIG. 5 is a timing diagram illustrating operations for using AR forsecure transactions, according to some embodiments.

FIG. 6 is a block diagram of embodiments of devices discussed withreference to FIGS. 1-5.

DESCRIPTION OF EMBODIMENT(S)

The description that follows includes exemplary systems, methods,techniques, instruction sequences and computer program products thatembody techniques of the present inventive subject matter. However, itis understood that the described embodiments may be practiced withoutthese specific details. For instance, although many examples refer toAR, computer-generated images that simulate a user's physical presencein an imaginary environment can be used instead, such as Virtual Reality(VR). In some embodiments, AR and VR can be used interchangeably. Insome embodiments, AR and VR can be used at the same time. In someembodiments, mixed reality (MR) can be used instead, where virtual andreal worlds are combined. In MR, immersive environments are created thatallow a user to interact with real world environments (such as viauser-controlled robots) via real and virtual elements.

A computer device can generate an AR environment by augmenting a user'sview of a real-world environment using computer-generated elements, suchas by using sound, video, and/or other sensory outputs. An AR device canbe implemented using AR glasses or another device that generates images(or accesses generated images) and overlays a user-accessed view of areal-world. AR images can be displayed via AR glasses that are worn bythe user, and thus can augment a real-world view seen by the user.

The AR device can determine objects and/or images at which the user islooking. The AR device can use eye-tracking, or another technique, todetermine a field-of-view that is viewed by the user of the AR device(also referred to as a “user view”) of a real-world. For example, the ARdevice can have a camera (and/or other optical sensors) that can takevideos and/or multiple photos, referred to collectively as imageacquisition. The AR device can analyze the acquired images, such as byapplying image analysis, to determine content of these images. Forexample, the AR device (or another device in communication with the ARdevice) can perform image analysis to detect certain elements in theviewed image(s). The AR device can also determine images and/or elementsin these images that are most often viewed by the user.

The user may also access a transaction server to conduct one or moretransactions on an account of the user. For example, the transactionserver may implement a payment system, and can process a paymenttransaction that are initiated by the user. The user can use anotherdevice, such as a laptop or a mobile device to access the transactionserver. For example, the user can use a mobile device to access thetransaction server to initiate a payment transaction from the user'saccount at the transaction server to another server, such as a merchant.The user can also access a processing server, via the mobile device,which can be associated with a merchant, to initiate a transaction withthe transaction server. For example, the user can access, via a webbrowser or an application executing on the mobile device, the processingserver. The processing server can communicate with the web browser orapplication to provide functionality to initiate the transaction. Themobile device can display an interactive transaction element, such as abutton or a dialog box, for prompting the user to initiate thetransaction.

The user can operate the mobile device while using the AR device. The ARdevice can acquire an image of the display of the mobile device. The ARdevice can determine, based on analysis of the image, that the displaydisplays an interactive transaction element for a transaction betweenthe user of the mobile device and a server. The AR device cancommunicate with the server that provides the interactive transactionelement, to move functionality of the interactive transaction elementfrom the mobile device to the AR device. The AR device can then generatea new interactive transaction element providing access to thetransaction at the server. The AR device can then provide access to thenew interactive transaction element that is visually projected ontocertain real-world images seen by the user via the AR device.

Therefore, the methods described herein allow a user to use his or herAR device to securely conduct a transaction that was initiated at anon-secure device. The non-secure device can be a mobile device, alaptop, or another device that is not authenticated to access the user'saccount at a server. Instead of authenticating for the transaction viathe non-secure device via a displayed interactive element, the user canuse the AR device to acquire an image from a display of the non-securedevice. The AR device can perform image analysis on the image todetermine that the image includes the interactive element, such as acheckout button, for the transaction. The AR device can access thetransaction at the server to provide authenticated access to thetransaction to the user via the AR device. The AR device can determineto display, via a AR display, a new interactive element referencing thetransaction. The AR device can determine to display the new interactiveelement based on a geographical location of the user, as well as on theuser's view via the AR device. The following description, and associatedFigures, illustrates various embodiments directed to the ideas listedabove.

FIG. 1 is a system diagram illustrating embodiments of a system thatuses an AR device for securely processing transactions that areinitiated at another device. In an overview of a system diagram 100, auser device 102 includes a display 106. The user device also hosts anapplication 104 that provides elements (e.g., an interactive transactionelement 112A) to the display 106 for displaying. The application 104 canreceive user input via the display 108. The application can communicatewith a processing server 114.

In some embodiments, the user device 102 can communicate with theprocessing server 114 to initiate a transaction. For example, theprocessing server 114 can communicate with the user device 102 todisplay, on the display 106, images of products and/or services that canbe purchased by the user. The user can access the processing server 114,as via the application 104 that can be a stand-alone application orclient functionality accessed via a web browser, to initiate atransaction. The transaction can be for purchase of a product and/orservice that is offered by the processing server 114 (e.g., a merchantor a service provider). The transaction can be for a transfer of fundsbetween a user account at the transaction server 124 and another account(such as at the transaction server 124 or at another system). Thetransaction can be for initiating a software service (e.g., asoftware-as-a-service (SaaS)) that is provided to the user device 102 bythe processing server 114. The transaction server 124 can provideauthentication of the user device 102 (and/or of the user) to theprocessing server 114 to process the transaction. The processing server114 may require the authentication from the transaction server 124 priorto processing of the transaction.

The AR application 120 can also be any type of an application thatrequires an acknowledgement and/or authorization from the user. The ARapplication 120 can be a payment application that requires authorizationfrom the user to confirm a payment transaction. The AR application 120can be a stand-alone application, or a client functionality accessed viaa web browser. The AR application 120 can be also used to authenticatethe user to access the user account at the transaction server 124. Theuser can interact with the AR application 120 via the AR display 122,such as via the new interactive transaction element 112B. The ARapplication 120 can also perform image analysis on acquired images, suchas to determine whether the images include representations of certainelements. The AR application 120 can also perform image analysis todetermine whether a scene image (of the acquired image) matches certainpre-determined scenes.

In some embodiments, AR device 116 can receive a user selection 110B bytracking user gestures. For example, the AR device 116 can use camerasto track location and movement of user's arm, hand, and/or fingers todetermine whether the user selects the new interactive transactionelement 112B. The AR device 116 can receive the user selection 110Bbased on user's gestures as determined by the cameras. In someembodiments, the AR device 116 can use motion detection sensors such asinfrared sensors and/or photodetectors to detect hand motions and/orgestures. The AR device 116 can track the movement of user's hand viatracking gloves worn by the user, where the tracking gloves can includesensors that detect user's hand and/or finger movements. The AR device116 can receive the user selection 110B based on position and/or signalsreceived from a pointing device held by the user. The AR device 116 canprovide haptic feedback to the user to indicate that the user selection110B has been received.

The processing server 114 can be associated with a merchant/or a serviceprovider and the transaction server 124 is associated with a paymentsystem. In this case, the processing server 114 can receive a requestfrom the user device 102 (e.g., via the application 104) for initiationof a transaction, for purchase of a product and/or service, at theprocessing server 114. In response to receiving the request, theprocessing server 114 can communicate with the transaction server 124 todetermine whether the user is authenticated for the transaction and/orfor initiating a payment for the purchase.

In some embodiments, in response to receiving the request, theprocessing server 114 can request an interactive transaction elementfrom the transaction server 124. The interactive transaction element canbe communicated by the transaction server 124 to the processing server114 using indicator code. The indicator code can be a snippet of code,an applet, an executable, a control, and/or a plug-in, among others. Inone embodiment, instead of the indicator code, the transaction server124 can communicate instructions to the processing server 114 forpresenting the interactive transaction element to the user device 102for display at the display 106. The instructions can be implemented as afunction call, a call-back, a web-hook, and/or a command. Upon receivingthe indicator code (or the instructions), the processing server 114 cancommunicate the indicator code (or the instructions) to the user device102.

In some implementations, a single server (not shown) can implementfunctionality of both the transaction server 124 and the processingserver 114. In this implementation, the single server can communicatewith the user device 102 directly. Thus, the single server can transmitthe indicator code or instructions to the user device 102. In eitherserver implementation, upon receiving the indicator code (or theinstructions), the user device 102 can generate the interactivetransaction element, and display this element on the display 106 as acheck-out button, a dialog box, or a control element.

The user can interact with the interactive transaction element 112A viaa user input, such as a user touch selection at 110A of the interactivetransaction element 112A on a touch-screen display implementation of thedisplay 106. The user can select (via the 110A) the interactivetransaction element 112A to initiate the transaction with the processingserver 114 (or with the single server, depending on the implementation).If the user is authenticated, the processing server 114 can startprocessing the transaction upon receiving an authentication indicationfrom the transaction server 124. If the user is not authenticated, thetransaction server 124 can start an authentication process prior tocommunicating the authentication indication to the processing server forstarting the transaction processing.

The AR device 116 can be worn and/or accessed by the user. As discussedabove, the AR device 116 can be implemented using AR glasses or anotherdevice that overlays AR elements on the field-of-view (also referred toas a “user view”) of a real-world as viewed by the user via the ARdevice 116. AR elements can be visual elements that can be generated bythe AR device 116, or are received from another device or server. ARelements can be displayed by the AR device 116 on the user view toaugment the real-world view seen by the user using the AR device 116.The AR device 116 can acquire an image of the display 106. For example,the AR device 116 can include cameras or other optical sensors, whichcan be used to acquire (shown as 118 in FIG. 1) the image. The ARapplication 120 can then analyze the acquired image, and based onanalysis of the image, detect a representation of the interactivetransaction element 112A in the acquired image. The AR application 120can thus determine, based on the image analysis, whether the display 106of user device 102 displays the interactive transaction element 112A.

The AR application 120 can transmit a move request to the transactionserver 124 (or with the single server) for moving functionality of theinteractive transaction element 112A from the user device 102 to the ARdevice 116. Upon receiving the move request from the AR device 116, thetransaction server 124 can communicate the indicator code (orinstructions) to the AR device 116 for displaying the interactivetransaction element on an AR display 122. Upon receiving the movecommunication from the AR device 116, the transaction server 124 canalso communicate (e.g., via the processing server 114) removeinstructions to the user device 102 for removing the functionality ofthe interactive transaction element from application 104. The removeinstructions can also instruct the application 104 to remove theinteractive transaction element from being displayed on the display 106.

The AR application 120 can, responsive to receiving the indicator codeor instructions from the transaction server 124, display the interactivetransaction element 112B on the AR display 122 at a custom location of ascene that is visually accessible via the AR device 116. The ARapplication 120 can determine the custom location based on a visualscene that is accessible, by the user, via the AR device 116, as well asbased on a user configuration. The user configuration can indicateseveral locations of one or more scenes accessible via the AR device 116where the AR device 116 can superimpose the interactive transactionelement 112B. FIGS. 3 and 4 illustrate embodiments of how AR device 116can superimpose the interactive transaction element 112B.

The application 104 can be any type of an application that requires anacknowledgement and/or authorization from the user. The application 104can be a payment application that requires authorization from the userto confirm a payment transaction. The application 104 can be astand-alone application, or a client functionality accessed via a webbrowser. The application 104 can be also used to authenticate the userto access the user account at the transaction server 124. The user caninteract with the application 104 via the display 106, such as via theinteractive transaction element 112A.

In some embodiments, the user device 102 and the AR device 116 are thesame device (referred to herein as a “single device”), such as a mobilephone. The single device can host both the application 104 and the ARapplication 120. The single device can also provide access to thedisplay 106, as well as to the AR display 122. Similarly as discussedabove, the application 104 can require authorization from the user toconfirm a transaction being initiated at the processing server. The ARapplication 120 can receive a transaction signal indicating thetransaction at the application 104. The transaction signal can bereceived from an operating system on the single device, from the user,or a notification from the application 104. The AR application 120 canaccess a screenshot of the application 104 as the image that includesthe interactive transaction element. The AR application can then performthe image analysis on the image to detect the interactive transactionelement and to determine the transaction reference. Similarly asdiscussed above, the AR application 120 can then generate the newtransaction element that is displayed via the AR display 122. Thediscussion below also applies to the single device embodiments, with thenoted changes to how the images are acquired.

FIG. 2 is a flow diagram illustrating embodiments of operations forusing AR for secure transactions. The method of FIG. 2 is described withreference to the systems and components described in FIG. 1 (forillustration purposes and not as a limitation). The example operationscan be carried out by the AR application 120.

Beginning with 202, the application acquires, via an AR device, an imageof display of a user device. With reference to FIG. 1, the ARapplication 120 can acquire the image of the display 106 of the userdevice 102. The AR application 120 can obtain the image from camera(s)and/or other sensors of the AR device 116.

At 204, the application determines, based on image analysis of theimage, that the user device displays an interactive transaction elementfor a transaction. With reference to FIG. 1, the AR application 120 cananalyze the acquired image and, based on this image analysis, determinethat the user device 102 displays (e.g., via the display 102) theinteractive transaction element 112A. In some embodiments, the ARapplication 120 can, based on image analysis, obtain a transactionreference for the transaction.

The AR application 120 can determine that the interactive transactionelement 112A includes an embedded identifier that can be used as thetransaction reference. For example, the interactive transaction element112A can include a QR code that is embedded around the interactivetransaction element 112A or inside a portion of the interactivetransaction element 112A. In other implementations, the interactivetransaction element 112A can include the identifier that is embedded orotherwise obscured. For example, the interactive transaction element112A can include the identifier that is implemented using a SnapTag, a2-dimensional bar code, and/or a SPARQCode, among others.

At 206, the application communicates with a server to move functionalityof the interactive transaction element 112A from the user device 102 tothe visual I/O device. With reference to FIG. 1, the AR application 120can communicate a move request to the transaction server 124 for movingthe functionality of the interactive transaction element 112A from theuser device 102 (including from the display 106) to the AR device 116(including to the AR display 122).

At 208, the application determines whether the transaction is accessiblevia the visual I/O device. With reference to FIG. 1, the AR application120 determines whether the transaction referenced by the interactivetransaction element 112A is accessible at the transaction server 124. Insome embodiments, the transaction is accessible if the AR application120 can obtain a transaction reference that allows the AR application120 to access the transaction at the transaction server 124. In someembodiments, the transaction is accessible if the AR application 120 isauthenticated to access the transaction at the transaction server 124.If the application determines that the transaction is accessible, flowcontinues at 212. Otherwise, flow continues at 210. At 210, theapplication communicates with the user device to obtain transactionreference. The AR application 120 can communicate with the user device102, over the communication link 130, to obtain the transactionreference for the transaction referenced at 204. The AR application 120can then access the transaction at the transaction server 124 using thetransaction reference. After 210, the flow continues at 206.

At 212, the application generates a new interactive transaction elementproviding access to the transaction. With reference to FIG. 1, the ARapplication 120 generates the new interactive transaction element 112Bthat provides access to the transaction at the transaction server 124.The AR application 120 can generate the new interactive transactionelement 112B at a custom location of a user view of the user. The userview can be the user-accessed view of the real-world, as seen by theuser via the AR device. The custom location can be determined based onthe user view and/or user preferences.

The AR application 120 can determine the custom location of the newinteractive transaction element 112B based on a geographical location ofthe AR device 116. The AR application 120 can determine whether the ARdevice 116 is physically located at, or near, one of pre-definedgeographical locations (e.g., as defined by user preferences). The ARapplication 120 can then display the new interactive transaction element112B anywhere on scene images acquired at the geographical location. Forexample, the AR application 120 can determine that the AR device islocated at a geographical location of the user's home which is one ofthe pre-defined locations. The AR application 120 can then display thenew interactive transaction element 112B on any scene image acquired bythe AR device 116 at the user's home.

The AR application 120 can determine the custom location of the newinteractive transaction element 112B based on whether a scene imageacquired by the AR device 116 matches a pre-determined scene. The ARapplication 120 can analyze the scene image acquired by the AR device116. In some embodiments, the AR application 120 can continuouslyanalyze scene images acquired by the AR device 116 for matches. In someembodiments, the AR application can analyze scene images acquired by theAR device 116 only at certain geographical locations, or a certain typeof locations, such as only at coffee houses. The AR application candisplay the new interactive transaction element 112B only to augmentcertain locations of scene images. For example, the AR application candetermine that the new interactive transaction element can only besuperimposed at a certain area of a table of a scene image acquired at acertain coffee house. FIGS. 3 and 4 illustrate embodiments of how ARdevice 116 can superimpose the interactive transaction element 112B.

In some embodiments, after generating the new interactive transactionelement 112B, the AR application 120 determines whether the interactivetransaction element 112A is removed from the image displayed by thedisplay 106. The AR application 120 can thus perform additional imageanalysis on additional acquired images of the display 106 of the userdevice 102. The AR application 120 can perform 214 in response todetermining that the interactive transaction element 112A is removedfrom the image. If the interactive transaction element 112A is notremoved from the image, the AR application 120 can communicate directlywith the user device 102, e.g., via a direct communication link 130,with a request to remove the interactive transaction element 112A fromthe image.

At 214, the application provides access to the new interactivetransaction element. With reference to FIG. 1, the AR application 120can provide access to the new interactive transaction element 112B onthe AR display 122. The user can interact with the interactivetransaction element 112B via a user input, such as via the userselection 110B.

The AR application 120 can access the user selection 110B of the newinteractive transaction element 112B. The AR application 120 candetermine that the user selection 110B indicates a confirmation of thetransaction by the user, and then transfer control (e.g., ability toinitiate processing) of the transaction to the user device 102. Thus,the user can complete the transaction via the user device 102 (e.g., viathe application 104) after the transaction is confirmed via the ARdevice 116. The transaction server 124 can also communicate with theprocessing server that the transaction is confirmed and will becompleted via the user device 102.

The AR application 120 can determine that the user selection 110Bindicates an authentication of the user, and then communicate anindication of the user authentication to the transaction server 124. Theuser can then complete the transaction via the AR device 116 (e.g., viathe AR application 120). The transaction server 124 can also communicatean indication of the user authentication to the processing server 114,such that the user can complete the transaction via the user device 102(e.g., via the application 104).

FIG. 3 is a diagram illustrating embodiments of using an AR device toaccess transactions initiated at another device. FIG. 3 illustrates howthe AR device 116 is used by the user 302 to view a real-world scene 304of physical surroundings of the user 302. The AR device 116 provides theuser 302 a user view 306 of the real-world scene 304, as well as the ARdisplay 122. The AR device 116 can overlay digital images and elementson the AR display 122, such that they appear, to the user 302, a part ofthe real-world scene 304 when viewed via the user view 306.

The AR device 116 can acquire an image 308 of the real world scene 304.In some embodiments, the AR device 116 can acquire the image 308 suchthat it coincides with the user view 306. In some embodiments, the ARdevice 116 can determine to acquire the image 308 that is a differentsize from that of the user view 306. The acquired image 308 may includedigital representations of the real-world scene 304, including a digitalrepresentation of the user device 102. The AR device 116 (or anotherdevice in communication with the AR device 116) can perform imageanalysis on the acquired image 308 to determine that the user device 102includes the interactive transaction element 112A.

FIGS. 4A and 4B are diagrams illustrating embodiments of a display shownby an AR device when implementing AR for secure transactions. FIG. 4Aillustrates the AR display 122 as seen by the user 302 via the AR device116. The user can see the user view 306 (as shown in FIG. 4B) via the ARdisplay 122. The AR device 116 also displays the generated interactivetransaction element 112B. The AR device 116 can detect the userselection 110B, which can indicate a user selection of the generatedinteractive transaction element 112B. As discussed above, the AR device116 can detect the user selection 110B via a variety of methods,including by tracking of user 302 gestures, detecting hand motion of theuser 302, and/or receiving signals from a pointing device 310 held bythe user 302.

FIG. 4B illustrates another view of how the user 302 sees the AR display122 via the AR device 116. The user 302 can see the user view 306 of areal world scene as well as elements superimposed by the AR device 116.As shown in FIG. 4B, the AR device 116 can overlay, using the AR display122, the interactive transaction element 112B over the user view 306.The AR device 116 can detect that the user selection 110B of theinteractive transaction element 112B.

The AR device 116 can acquire another image 402 of the real-world sceneshown in FIG. 4B. The AR device 1156 can perform image analysis of theacquired image 402 to determine that the user device 102 has removed theinteractive transaction element 112A from the display 106. It is notedthat in some cases, the AR device 116 may not display the generatedinteractive transaction element 112B if the AR device 116 determinesthat the acquired image 402 does not match a pre-defined scene.

FIG. 5 is a timing diagram illustrating operations for using AR forsecure transactions, according to some embodiments. As shown by FIG. 5,the AR application 120 communicates with the transaction server 124. Theapplication 104 communicates with the processing server 114. Theprocessing server 114 also communicates with the transaction server 124.The communications of FIG. 5 can be performed over one or morecommunication networks. Portions of the timing diagram of FIG. 5correspond to the flow diagram of FIG. 2.

At 502, the application 104 communicates with the processing server 114.The application 104 can transmit a transaction request, such as toinitiate a transaction. For example, the application 104 can access theprocessing server 114 to initiate a service request at the processingserver 114 (which can implement a service server). At 504, theprocessing server 114 can determine how to process the transaction. At506, the processing server 114 can communicate with the transactionserver 124, such as to request an interactive transaction element.

At 506, the processing server 114 can communicate with the transactionserver 124 to determine whether the application 104 and/or the user isauthenticated for the transaction at the transaction server 124. In thetransaction flow shown by FIG. 5, the processing server 114 requiresauthentication of the application 104 and/or the user prior toprocessing the requested transaction. At 508, the transaction server 124can determine whether the user application 104 and/or the user isauthenticated for the requested transaction. At 508, the transactionserver 124 can also determine whether to communicate the interactivetransaction element to the processing server 114.

At 510, the transaction server 124 can communicate the interactivetransaction element to the processing server 114 using indicator code orinstructions. At 511, the processing server 114 can communicate theindicator code or instructions to the application 104. At 512, theapplication 104 can display the interactive transaction element on thedisplay 106. At 513, the AR application 120 can acquire an image of thedisplay 106. At 514, the AR application 120 can perform image analysison the acquired image to determine that the display 106 displays theinteractive transaction element.

In some embodiments, at 516, the AR application 120 can communicate(e.g., via move instructions) with the transaction server 124 to movethe functionality of the interactive transaction element from theapplication 104 to the AR application 120. At 518, the AR application120 can determine to provide a new interactive transaction element tothe AR application 120, and optionally to remove the interactivetransaction element functionality from the application 104. At 520, thetransaction server 124 can communicate indicator code or instructionsfor the new interactive transaction element to the AR application 120.At 521, the transaction server 124 can communicate with the processingserver 114 to remove and/or de-activate functionality of the interactivetransaction element from the application 104. At 522, the processingserver 114 can communicate with the application 104 to remove and/orde-activate functionality of the interactive transaction element.

Alternatively, the processing server 114 can de-activate functionalityof the interactive transaction element without communicating with theapplication 104. Thus, the de-activation is local to the processingserver 114, and that the user selection 110A received from theapplication 104 by the processing server 114 can be ignored (e.g., withregard to initiating processing of the transaction). In thisimplementation, the processing server 114 can wait on receivingcommunication from the AR application 120 (e.g., via the transactionserver 124) prior to initiating processing of the transaction.

In other embodiments, the AR application 120 can generate the newinteractive transaction element offline, e.g., without step 516. Thus,the AR application 120, after determining that the display 106 displaysthe interactive transaction element, can generate the interactivetransaction element without communicating with the transaction server124. In this implementation, the AR application 120 can obtaininformation necessary for generation of the new interactive transactionelement from the image analysis at 514. For example, the AR application120 can determine a transaction reference based on the image analysis,and customer ID based on association of the AR device with the user. Inanother implementation, the AR application 20 can communicate with theapplication (e.g., via the communication link 130) to obtain thetransaction reference. Thus, the steps 516-522 are omitted.

At 523, the AR application 120 can receive user selection of the newinteractive transaction element. At 524, the AR application 120 cancommunicate, to the transaction server 124, indication of the userselection of the new interactive transaction element. At 526, the ARapplication 120 can authenticate the user and/or the AR application 120for the transaction. At 526, the transaction server 124 can communicatewith the processing server 114 to indicate that the user and/or the userdevice is authenticated for the transaction.

It should be understood that FIGS. 1-5 and the operations describedherein are examples meant to aid in understanding embodiments and shouldnot be used to limit embodiments or limit scope of the claims.Embodiments may perform additional operations, fewer operations,operations in a different order, operations in parallel, and someoperations differently. For example, one or more elements, steps, orprocesses described with reference to the diagrams of FIGS. 1-5 may beomitted, described in a different sequence, or combined as desired orappropriate.

As will be appreciated by one skilled in the art, aspects of the presentdisclosure may be embodied as a system, method, or computer programproduct. Accordingly, aspects of the present disclosure may take theform of an entirely hardware embodiment, a software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “module” or “system.” Furthermore,aspects of the present disclosure may take the form of a computerprogram product embodied in one or more computer readable medium(s)having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: a portable computerdiskette, a hard disk, a random access memory (RAM), a read-only memory(ROM), an erasable programmable read-only memory (EPROM or Flashmemory), a portable compact disc read-only memory (CD-ROM), an opticalstorage device, a magnetic storage device, or any suitable combinationof the foregoing. In the context of this document, a computer readablestorage medium may be any tangible and/or non-transitory medium that cancontain, or store a program for use by or in connection with aninstruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device. Computer programcode embodied on a computer readable medium may be transmitted using anyappropriate medium, including but not limited to wireless, wireline,optical fiber cable, RF, etc., or any suitable combination of theforegoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The computer program code may execute (e.g., ascompiled into computer program instructions) entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).

Aspects of the present disclosure are described with reference to flowdiagram illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of thepresent disclosure. It will be understood that each block of the flowdiagram illustrations and/or block diagrams, and combinations of blocksin the flow diagram illustrations and/or block diagrams, can beimplemented by computer program instructions. These computer programinstructions may be provided to a processor of a general purposecomputer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the computerprogram instructions, which execute via the processor of the computer orother programmable data processing apparatus, create means forimplementing the functions/acts specified in the flow diagrams and/orblock diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flow diagram and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flow diagrams and/orblock diagram block or blocks.

FIG. 6 is a block diagram of an exemplary embodiment of an electronicdevice 600 including a communication interface 608 for networkcommunications. The electronic device can embody functionality toimplement embodiments described in FIGS. 1-5 above. In someimplementations, the electronic device 600 may be a laptop computer, atablet computer, a mobile phone, a powerline communication device, asmart appliance (PDA), a server, and/or one or more another electronicsystems. For example, a user device may be implemented using a mobiledevice, such as a mobile phone or a tablet computer. For example, apayment system may be implemented using one or more servers. Theelectronic device 600 can include a processor unit 602 (possiblyincluding multiple processors, multiple cores, multiple nodes, and/orimplementing multi-threading, etc.). The electronic device 600 can alsoinclude a memory unit 606. The memory unit 606 may be system memory(e.g., one or more of cache, SRAM, DRAM, zero capacitor RAM, TwinTransistor RAM, eDRAM, EDO RAM, DDR RAM, EEPROM, NRAM, RRAM, SONOS,PRAM, etc.) or any one or more of the above already described possiblerealizations of machine-readable media. The electronic device 600 canalso include the bus 610 (e.g., PCI, ISA, PCI-Express, HyperTransport®,InfiniBand®, NuBus, AHB, AXI, etc.), and network interfaces 604 caninclude wire-based interfaces (e.g., an Ethernet interface, a powerlinecommunication interface, etc.). The communication interface 608 caninclude at least one of a wireless network interface (e.g., a WLANinterface, a Bluetooth interface, a WiMAX interface, a ZigBee interface,a Wireless USB interface, etc.), In some implementations, the electronicdevice 600 may support multiple network interfaces—each of which isconfigured to couple the electronic device 600 to a differentcommunication network.

The memory unit 606 can embody functionality to implement embodimentsdescribed in FIGS. 1-5 above. In one embodiment, the memory unit 606 caninclude one or more of functionalities that implements using an ARdevice for securely processing transactions that are initiated atanother device. Any one of these functionalities may be partially (orentirely) implemented in hardware and/or on the processor unit 602. Forexample, some functionality may be implemented with an applicationspecific integrated circuit, in logic implemented in the processor unit602, in a co-processor on a peripheral device or card, etc. Further,realizations may include fewer or additional components not illustratedin FIG. 6 (e.g., video cards, audio cards, additional networkinterfaces, peripheral devices, etc.). The processor unit 602, thememory unit 606, the network interface 604 and the communicationinterface 608 are coupled to the bus 610. Although illustrated as beingcoupled to the bus 610, the memory unit 606 may be coupled to theprocessor unit 602.

While the embodiments are described with reference to variousimplementations and exploitations, it will be understood that theseembodiments are illustrative and that the scope of the presentdisclosure is not limited to them. In general, techniques for using anAR device for securely processing transactions that are initiated atanother device as described herein may be implemented with facilitiesconsistent with any hardware system or hardware systems. Manyvariations, modifications, additions, and improvements are possible.

Plural instances may be provided for components, operations orstructures described herein as a single instance. Finally, boundariesbetween various components, operations and data stores are somewhatarbitrary, and particular operations are illustrated in the context ofspecific illustrative configurations. Other allocations of functionalityare envisioned and may fall within the scope of the present disclosure.In general, structures and functionality presented as separatecomponents in the exemplary configurations may be implemented as acombined structure or component. Similarly, structures and functionalitypresented as a single component may be implemented as separatecomponents. These and other variations, modifications, additions, andimprovements may fall within the scope of the present disclosure.

What is claimed is:
 1. An augmented reality device comprising: one ormore computer-readable memories storing program instructions; and one ormore processors configured to execute the program instructions to causethe augmented reality device to perform operations comprising:detecting, based on an analysis of an image displayed on a user devicethat is different from the augmented reality device, that the imageincludes an interactive element corresponding to a transaction that isinitiated on the user device; transmitting, to a server, a request tomove a functionality corresponding to the interactive element from theuser device to the augmented reality device, wherein the transmittingthe request causes the server to create a new interactive element; andin response to receiving information corresponding to the newinteractive element from the server, visually displaying the newinteractive element.
 2. The augmented reality device of claim 1, whereinthe new interactive element is displayed on the augmented reality deviceand includes an embedded identifier.
 3. The augmented reality device ofclaim 1, the operations further comprising: in response to detecting aselection of the new interactive element, causing the transaction to beprocessed.
 4. The augmented reality device of claim 1, wherein thetransmitting the request further causes the server to determine that thetransaction corresponding to the interactive element is accessible bythe augmented reality device.
 5. The augmented reality device of claim4, wherein a determination that the transaction corresponding to theinteractive element is accessible by the augmented reality deviceincludes a determination that the augmented reality device isauthenticated to access the transaction.
 6. The augmented reality deviceof claim 1, wherein a determination that the transaction correspondingto the interactive element is accessible by the augmented reality deviceincludes a determination that the augmented reality device has obtaineda transaction reference corresponding to the transaction.
 7. Theaugmented reality device of claim 1, the operations further comprising:in response to a detection of a selection of the new interactiveelement, transmitting an indication of a confirmation of the transactionand transferring control of the transaction to the user device.
 8. Amethod comprising: detecting, by an augmented reality device, based onan analysis of an image displayed on a user device that is differentfrom the augmented reality device, that the image includes aninteractive element corresponding to a transaction that is initiated onthe user device; transmitting, by the augmented reality device to aserver, a request to move a functionality corresponding to theinteractive element from the user device to the augmented realitydevice, wherein the transmitting the request causes the server to createa new interactive element; and in response to receiving informationcorresponding to the new interactive element from the server, visuallydisplaying, by the augmented reality device, the new interactiveelement.
 9. The method of claim 8, wherein the new interactive elementis displayed on the augmented reality device and includes an embeddedidentifier.
 10. The method of claim 8, further comprising: in responseto detecting a selection of the new interactive element, causing, by theaugmented reality device, the transaction to be processed.
 11. Themethod of claim 8, wherein the transmitting the request further causesthe server to determine that the transaction corresponding to theinteractive element is accessible by the augmented reality device. 12.The method of claim 11, wherein a determination that the transactioncorresponding to the interactive element is accessible by the augmentedreality device includes a determination that the augmented realitydevice is authenticated to access the transaction.
 13. The method ofclaim 8, further comprising: in response to a detection of a selectionof the new interactive element, transmitting an indication of aconfirmation of the transaction to the user device.
 14. The method ofclaim 13, further comprising: in response to a detection of a selectionof the new interactive element, transferring control of the transactionto the user device.
 15. A non-transitory machine-readable medium havinginstructions stored thereon, the instructions executable to causeperformance of operations comprising: detecting, via an augmentedreality device based on an analysis of an image displayed on a userdevice that is different from the augmented reality device, that theimage includes an interactive element corresponding to a transactionthat is initiated on the user device; transmitting, to a server, arequest to move a functionality corresponding to the interactive elementfrom the user device to an augmented reality device, wherein thetransmitting the request causes the server to create a new interactiveelement; and in response to receiving information corresponding to thenew interactive element from the server, visually displaying the newinteractive element on the augmented reality device.
 16. Thenon-transitory machine-readable medium of claim 15, wherein the newinteractive element is displayed on the augmented reality device andincludes an embedded identifier.
 17. The non-transitory machine-readablemedium of claim 15, the operations further comprising: in response todetecting a selection of the new interactive element, causing thetransaction to be processed.
 18. The non-transitory machine-readablemedium of claim 15, wherein the transmitting the request further causesthe server to determine that the transaction corresponding to theinteractive element is accessible by the augmented reality device. 19.The non-transitory machine-readable medium of claim 15, wherein adetermination that the transaction corresponding to the interactiveelement is accessible by the augmented reality device includes adetermination that the augmented reality device is authenticated toaccess the transaction.
 20. The non-transitory machine-readable mediumof claim 15, the operations further comprising: in response to adetection of a selection of the new interactive element, transmitting anindication of a confirmation of the transaction and transferring controlof the transaction to the user device.